Magnetic impurities on the surface of topological superconductor 
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We consider the effects of magnetic impurities on the surface of superconducting Cu doped Bi2Se3 
in the odd parity pairing phase which support topologically protected Majorana fermions surface 
states with linear spectrum. We show that a single magnetic impurity on the surface may induce a 
pair of in-gap localized bound states. The energy of the in-gap state is extremely sensitive to the 
orientation of the magnetic impurity due to the so-called Ising properties of Majorana fermions. 
The magnetic impurity induced spin-texture, which can be measured using spin sensitive STM, is 
calculated. We also show that the RKKY interactions between magnetic impurities mediated via 
the Majorana fermions are always ferromagnetic and dense enough magnetic impurities will develop 
long-range magnetic order and break the time-reversal symmetry on the material surface eventually. 
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Introduction — Topological superconductors (TSCs) 
are new states of matter with bulk pairing gap and sym- 
metry protected gapless boundary modes. |l|-[7j The zero 
energy surface Andreev bound states (SABSs) are Ma- 
jorana fermions (MFs) as they act as their own anti- 
particles due to particle-hole (PH) symmetry. It has 
been shown that the self-Hermitian property of MFs is 
the origin of several interesting phenomena such as the 
MF induced resonant Andreev reflection [8|,l9[ and the 4tt 
Josephson effect flol-[l5| . Particularly, it has been shown 
that MFs boundary states only interact with one spe- 
cific direction the magnetic impurities where the specific 
direction is determined by the pairing symmetry of the 
bulk superconductor and the surface orientation. This 
is called the Ising spin properties of MFs. The conse- 
quences of the Ising spin properties of MFs for the sur- 
face states of He3 B phase [16j and for edge states of 
two-dimensional superconductors |l7j have been studied. 
It is shown that the magnetic susceptibilities of mag- 
netic impurities which interact with MFs exhibit strong 
anisotropy due to the Ising properties of MFs. However, 
the Ising spin properties of MFs of a three dimensional 
TSC are yet to be explored. 

The recently discovered superconducting topological 
insulator (STI) Cu x Bi2Se3 is a possible realization of 
a three dimensional TSC.JlH ^ nas been proposed 
that Cu£Bi2Se3 is a TSC with odd-parity triplet pair- 
ing and fully gapped in the bulk [19| and this super- 
conducting phase s upp ort SABSs with linear disper- 
sion. Specific he at 12 Qj and point contact spectroscopy 
measurements 2l|, [22| of the material are consistent with 
this odd-parity triplet pairing phase. 

In this work, we consider the effects of magnetic im- 
purities coupled to the MFs emerged on the surface of 
an odd-parity triplet pairing TSC. We show that the 
magnetic impurity induced in-gap bounded states are ex- 
tremely sensitive to the orientations of the magnetic mo- 
ment due to the Ising properties of MFs. The spin tex- 
ture near a magnetic impurity, which can be measured 
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FIG. 1. (a) Illustration of a TSC with a single Majorana cone 
on the surface coupled to a magnetic impurity. The Ising spin 
direction of the Majorana modes is normal to the surface, (b) 
The modulation of the LDOS p(R, — 0.7A) around a magnetic 
impurity with scattering strength U/A = l which is polarized 
along the z-axis (n z = 1.0) is shown. The corresponding pin 
textures at energy uo — — 0.7A (c) and uj — — 0.5A (d) near the 
magnetic impurity are shown. The component in the xy plane 
is denoted by a vector while the background colour indicates 
the magnitude of s z (y,uj). The arrows are normalized to the 
longest in-plane spin length and a — hv s /A. 



using spin-resolved STM, is calculated. Moreover, we 
show that the RKKY interactions between magnetic im- 
purities mediated by the Ising MFs are always ferromag- 
netic. Finite density of magnetic impurities can break 
time-reversal symmetry spontaneously and open an en- 
ergy gap on the surface. When this happens, the TS 
becomes a quantum thermal Hall insulator. 

MF Ising spin — We start with the Bogoliubov-de 
Gennes (BdG) Hamiltonian of Cu :E Bi2Se3 given byJUj: 

h = J d 3 kei^(k)a, (i) 

H{k) = [H (k) - v}t z + Aa y s z r x . (2) 
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Here = (c/^, c/4, c^ fc ^, — cL fc ^) T are Nambu basis de- 
noted by the Pauli matrices r Xi y jZ and t, I are the electron 
spin indices. s^,^ are Pauli matrices. At low energy, the 
band structure of the parent compound Bi2Se3 is well de- 
scribed by the k • p Hamiltonian: 

H (k) = ma x + v(k x a z s y - k y a z s x ) + v z k z a y , (3) 

where a z = ±1 is an orbital index which denotes the 
two Se p z orbitals on the top and bottom layer in each 
unit cell. When m = 0, the bulk is a single species of 
noninteracting three-dimensional Dirac quasiparticles. 

The BdG Hamiltonian describes a Dili class [HI, |23| 
superconductor which satisfies 0i^(k)O -1 = H{— k) 
and Ji7(k)J _1 = — H{— k), where 9 = is y K and 
J — S y T y I^l. are the time-reversal symmetry and particle- 
hole symmetry operators respectively. Interestingly, the 
Hamiltonian satisfy an extra inversion (Z2) symmetry 
<j x T z H(k)<j x T z = H(— k) where <j x is an inversion opera- 
tor interchanging two orbitals. In this work, we consider 
the superconducting pairing denoted by A = Aa y s z r x 
with a x A<j x = — A which is an odd-parity inter-orbital 
triplet pairing. Such pairing symmetry is consistent with 
the crystal point group D^d of the Cu^E^Ses and fully 
gapped in the bulk. A superconductor described by Eqj3] 
can support topologically protected MF surface states as 
shown below . [19| 

To study the surface states, we consider the case where 
the superconductor is terminated at the z — plane 
where the wave function on the topmost layer vanishes, 
i.e. G z %jj\ z= Q = —ijj\ z= Q. By solving the semi-infinite BdG 
equation at k x = k y = 0, we find a Kramers pair of 
zero-energy surface Andreev bound states ip±, 



il>.{z) = Ae KZ 



sm(kpz) 
sin(kFZ + 6 



s,r y = sgn(v z )s), 
(4) 



where k = A/\v z \, v z kp = \/ [i 2 — m 2 and e %e = (m 



m 2 )/ ji. A is the normalziation constant for the 



wavefunctions. By k • p theory, we obtain the low-energy 
Hamiltonian H s for surface Andreev bound states by ex- 
panding at small momentum, 



H 8 (k) = v s (k x 



(5) 



where the renormalized velocity in the effective Hamilto- 



nian is, 



k(1 - cos 2(9) + k F sin 2(9 
I (n 2 + k 2 F ) - n(l + cos 2(9) + k F sin 2(9 ' 



(6) 



The effective Hamiltonian describes the gapless Majo- 
rana fermions on the surface boundary up to a high 
energy cutoff A within the bulk gap. In general, s = 
(s x ,s y ,s z ) are SU(2) Pauli matrices which describes the 
coupling between two branches ^ s (k, z) with opposite s z 




FIG. 2. The resonant energy and the lifetime of the localized 
bound state by varying the coupling strength Un z . The black 
solid line is the resonant energy ftw\ oc / A while the red dash 
line is the relaxation rate (h/An oc ) of the associated localized 
state. 



and r y . In this explicit model they are identical to the 
physical spin, (s x ,s y ,s z ). The velocity of the bound- 
ary Major ana modes has a sign change depending on the 
value of m and v s ~ vA 2 /p 2 as m — )• 0. The sign change 
corresponds to a structural transition of energy disper- 
sion of the surface modes. [24] For positive value of m, 
the energy spectrum of SABS forms a Dirac cone. In- 
deed, when m becomes negative, a second crossing of the 
zero energy appears at finite k and this crossing is pro- 
tected by the band-inversion of the parent topological 
insulator. [25 1 

The eigenstates of the effective Hamiltonian H s form 
two branches 0±(k) = ^(1, ±ie z6k ) T with energy Ek = 
±v s k which are localized on the boundary z = 0. Because 
of the PH symmetry, two branches are not independent 
and satisfy: </>+(k) = k). 

To study the interaction between the MF surface states 
and a local magnetic impurity, we need to construct the 
local electron operators. By rotating the spin quantiza- 
tion axis along the x-direction ^^(r), ^><_(r), the surface 
mode expansion of the local electron operators can be 
written as: 
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(7) 



smf^kpz) 
sin(kFZ + 6 



/ cos(^) \ 



2COS( fc 2 1 ) 
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where tan(9^ = k y /k x . The mode expansion satisfies 
the Majorana-like conditions: V^( r ) = — and 
Vv( r ) = ^^(r). For convenience, we define the Majo- 
rana operators 7a (r) = e m7r / 4 ^ a (r) with 7 a (r) = 7 a (r) 
for a =— ^— and the Majorana operators {7^,7^} 
transform to {7^, —7^} under the TR transformation. 
The effective Hamiltonian can be rewritten in term of 
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a spinless fermion / = (7^ + z7^_)/y / 2, 

H s = v s J d 2 Y^(v)(id x T y + id y T x )*(r), (8) 

where #(r) = (/(r), / t (r)) T and r = (r x ,r y ,T z ) are 
SU(2) Pauli matrices in the Nambu space. Accordingly, 
the physical spin SU(2) matrices s can transform into the 
new basis, i.e. (s x , s yi s z ) —> (t x , —r yi —t z ), respectively. 

Because of the Majorana nature of the surface modes, 
neither the local density operator p(r) = ^2 a ^(r)'0 Q! (r) 
nor the components of the local spin density opera- 
tors parallel to the surface, s x = ipt+ip-> — ip]-ip<- and 
s y = iipl^ip^ — iip^ip^ can be non-trivial. However it 
is possible to construct the non-trivial component of the 
spin density operator which is perpendicular to the sur- 
face, s z — V^VV- + V^LV^ = —2^7^ 7<_. The Ising-type 
spin density is crucial for Majorana boundary modes. Its 
strong anisotropy reflects the spin-triple pairing symme- 
try and the spin-orbital coupling in the bulk TSC. In the 
rest of this paper, we will analyse the effects of magnetic 
impurities coupled with this gapless Ising spin density. 

Magnetic impurity induced in-gap state — We 
first consider a static magnetic impurity with large mag- 
netic moment S which scatters the Majorana boundary 
modes classically with interaction strength J at the ori- 
gin r = 0. The scattering process can be described by 
the perturbation V = j drSfr^(r)(ri | V"|r 2 )\I/(r 2 ) where 

(r 1 |T>|r 2 ) = -^r^(r 1 )(5(r 2 ), (9) 

where U = JS. Here we have assumed the classical im- 
purity spin S = 5n, whose direction is given by the fixed 
unit vector n = (n x ,n y ,n z ). In contrast, the spin quan- 
tization axis of a quantum impurity spin is determined 
by the Ising-spin orientation of the surface modes. 

The effect of the magnetic impurity scattering can 
be addressed using the T-matrix technique with the T- 
matrix, [26| 

f(u) = V + VG° ret (u)f(u) = 1 V, (10) 

1 - VG ret (u) 

where G°(ri, r 2 , oS) = (ri |Gr et (o;)|r 2 ) is the bare Green 
function of the effective Hamiltonian H s in real space, 

G°(R,0,o;) = ^(/o(ii,a;)I 

+ f !(R, u)(r y cos 6 r + t x sin R )) . (11) 

Here Or is the angle of vector R from the x-axis. 
fo(R,u) = -sgn(uj)J (\uj\R)-iY (\uj\R) and h(R,uj) = 
—iJi(\u\R) +sgn(cj)Yi(|a;|i?) where Ji{x) , Yi(x) are the 
Bessel functions of the first and second kind respectively. 

Because of the local form of the scattering poten- 
tial Eq.® and the unperturbed on-site Green function 
G(0,0,cj) = go(uj)I is diagonal in r z , the T-matrix can 



be evaluated analytically and T(ri,r 2 ,cj) = (1*1 |T(co>)|r 2 ) 
becomes, 

Un z 

T(ri,r 2 ,u;) = * 2 (-r z + Un z gQl)8(Y 1 )5(Y 2 ). 

1 — u n z g 

(12) 

Here the unperturbed on-site Green function go(uj) is reg- 
ulated by a short-distance cutoff ao <C a « hv s / A. 

The full Green's function G ret = G° ret + G° ret TG° ret = 
G® et + SG re t can be computed using the T-matrix and 
the additional part 5G re t becomes, 

£G re t(r,r,cj) = B(u) {2if fi{cosO r r x - s\nO r r y ) 

+(fo+fi)Tz-(f$-f?)Un z gol), (13) 

where fi = fi(r,uj) for i = 0,1 and B(uo) = 
Un z u 2 /16tt(1 - U 2 n 2 z g (uj) 2 ). The pole of B(u) deter- 
mines the position of a localized bound state induced by 
a magnetic impurity where the imaginary part of its de- 
nominator determines the relaxation rate (l/r/ oc ) of it. 
As shown in Figj2j we find that there are always two 
localized states with energy ±ui oc for large enough cou- 
pling strength Un z , and the resonant energy uoi oc goes 
to zero as Un z — >> 00. On the other hand, the resonant 
energy will reach the cutoff value W for small enough 
value of Un Zl which implies that the magnetic impurity 
cannot induce any localized in-gap states if its magnetic 
moment pointing close to the material boundary or the 
coupling strength U to the surface modes is sufficiently 
weak. 

The local density of state (LDOS) p(R, 00) = 
— -^TrG re t(R, R, tj) varies due to the scattering with 
the magnetic impurity, 

p(R,Lo) = M + 23BHf/n z (/ 2 - ft). (14) 

The linear density of states reflects the linear energy dis- 
persion of the Majorana excitations in the absence of 
magnetic impurities. As shown in Fig.(j3^,b), we find low- 
energy resonances in LDOS induced by a magnetic impu- 
rity. The resonance peaks become sharper and approach 
to zero energy with increasing impurity strength, and 
they decay away from the impurity as 1/R 2 which can 
be determined by the scaling dimension of the Majorana 
operators. In contrast to the surface of three-dimensional 
topological insulator where in-gap states can be induced 
independent of the impurity moment orientation [26j, the 
modulation of the LDOS Jp(R, uo) shown in Fig.fl3k,b) is 
only sensitive to its projection along the z-axis. 

Similarly, the energy-resolved spin density averages, 
s(R, uj) = — ^$TrG r et (R, R, w) § , which can be mea- 
sured by the recently developed spin-resolved STM 
technique [13, is found to be 

s(R,w) = 9fB(w) ((/ 2 + fl)z - 2i/o/i(cos0 fl z + sm6 R y)) . 

(15) 
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FIG. 3. LDOS plots showing the low-energy resonances at 
R = 0.5a away from a magnetic impurity with (a) Un z / A = 
1.0 and (b) Un z /A — 0.5 respectively. Note that the reso- 
nance peak is sharper and stronger for larger Un z and the 
modulation of the LDOS at n z = 0.5 is pronounced at the en- 
ergy scale beyond the high-energy cutoff A . Energy resolved 
spin density plot at R = (0.5a, 0) at scattering strength (c) 
Un z /A = 1 and (d) Un z /A — 0.5 respectively. The black 
solid line is s x (R, a;) while the red dash line is s z (R, uj). We 
note that the modulation of the spin density is much weaker 
and extended beyond the high-energy cutoff A at Un z =0.5. 



In both cases, s y (R, oj) 



0. 



In Fig.([T|3,c), we show the energy-resolved spin textures 
around a magnetic impurity which is pointing in the nor- 
mal direction. We see that it induces not only the z- 
direction spin LDOS, but also an in-plane one which is 
originating from the helical nature of the surface modes. 
If the magnetic impurity pointing in other directions, the 
induced magnetization is similar to Fig.(pJ>,c) qualita- 
tively. However, the magnitude of the induced magneti- 
zation linearly proportional to the magnetic spin projec- 
tion to the Majorana Ising spin direction n z . We notice 
that the out-of-plane energy-resolved spin density is an 
odd function of energy while the in-plane one is even 
as shown in Fig.(|3k,d), which are originated from the 
PH symmetry on the boundary modes, J(H S + V) J -1 = 
— (H s + V) where J = r x K is the effective PH symme- 
try transformation on the surface. Furthermore, the in- 
plane energy-resolved spin densities satisfy the sum rules 
s Xi y(R,,uj)duj = which are also emerged from the 
Majorana nature of the underlying surface excitations. 

RKKY interaction — Finally, we consider the dy- 
namics of magnetic impurities interacting with helical 
Majorana excitations. In particular, we analyse the 
RKKY interactions between magnetic impurities medi- 
ated via the Majorana surface modes. In the Dili TSCs, 
we have shown that the coupling between the surface 
helical Majorana states and the magnetic impurities is 
effectively Ising for T <C A, 

ffex = -JSh z &(p)r z V(p), (16) 
and S z is the spin operator of a magnetic impurity which 



is projected perpendicular to the surface. The RKKY 
interaction between two magnetic impurities can be eval- 
uated by integrating out the Majorana modes using their 
real-space Green function, 



#rkky = J(ri - r 2 )n z (T 1 )n z (T 2 ), 



(17) 



where J(R) = J 2 x^(R)/4 and x**(R) = 
-£ J^duj^TT[G (R,uj)r z G°(-K,uj)r z ] is the spin 
susceptibility of the Majorana modes, which can be 
evaluated analytically for 2D helical Majorana fermions 



8nh\v s \R 3 ' 



(18) 



In evaluating the spin susceptibility Xzz, a soft cutoff 
function e~^l^ Q is used and we take the limit c^o — » oo 
after performing the integrals [30j • The RKKY interac- 
tions can also be derived from the energy-resolved spin 
average, Eq. ([T5]h if we integrate all the filled states with 
energy up to the chemical potential, \i = 0. 

From EqJTBl We see that the Ising interactions be- 
tween two impurities are always ferromagnetic. Inter- 
actions of an ensemble of magnetic impurities give rise 
to an ordered ferromagnetic phase with spins pointing 
perpendicular to the surface and breaks the TR sym- 
metry spontaneously, driving the surface state into a 
gapped one. According to Eq. ([18]) . the ordering tem- 
perature can be estimated as ksT c « J 2 a 4 n^ p /hv s , 
where ni mp is the impurity density. At the mean-field 
level, the ordering magnetic impurities open a mass gap 
m = riimpJS. Such a mass term breaks the TR sym- 
metry of the surface modes and exhibits an anomalous 
quantum Hall effect, provides a half quantized Hall ther- 
mal conductance an = sgn(m)/2fo. jiil l29| It is in con- 
trast to the effects of dense magnetic impurities on the 
surface of three dimensional TI where the RKKY inter- 
actions between magnetic impurities mediated via the 
helical fermionic surface modes are frustrated, and result 
in a disorder spin-glass phase in which the TR symmetry 
is still preserved. [28] 

Conclusion — In summary, we find that the local 
magnetic impurity can induced a pair of localized in- 
gap states on the 2D surface of three-dimensional Dili 
TSCs. Importantly, the energy of the induced in-gap 
states is sensitive to the orientations between the mag- 
netic impurity and the MF Ising spin direction. We also 
show that the RKKY-like interactions between magnetic 
impurities are ferromagnetic Ising. Therefore, at large 
densities of magnetic impurities, long-range magnetic or- 
dering is developed and TR symmetry on the surface is 
broken spontaneously. 
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